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Abstract 

We calculate moments of free energy's finite size correction for the 
transition point between ferromagnetic and spin glass phases. We 
find, that those moments scale with the number of spins with differ- 
ent critical indices, characteristic for the multiscaling. This critical 
point corresponds to threshold of errorless coding for a gaussian noisy 
channel. We are give the definition of statistical complexity using this 
free energy approach. 

The definition of statistical complexity is serious open problem in statisti- 
cal mechanics [1] . There have been some attempts, based mainly on entropy 
concepts [2-4]. 

In [5] I analyzed some complicated theories of modern physics-strings, 2d 
quantum disorder. They have some statistical mechanical structures, equiv- 
alent to Random Energy Model (REM) [6], so we can define REM class of 
complex phenomena. I distinguished 2 classes of complex phenomena: like 
to spin glass (SG) phase of REM [6] and the transition region between spin 
glass (SG) and ferromagnetic (FM) phases. In this work I am analyzing 
the second one (one is using term complexity today just for it) and give the 
definition (criteria) for statistical complexity. This is the phase of complex 
adaptive systems (CAS) [7]). What we know nowadays, such complex struc- 
tures arise between order and disorder (edge of chaos according to Kauffman 
[8]). In the REM case this point corresponds to errorless decoding treshold in 
information theory [9]. 

Let us solve the thermodynamics of REM at this region including finite size 
corrections, later try to generalize our results to define complexity. 
One has , that N spins Sj = ±1 interact trough = w^rmp P "~ > 00 
couplings with the hamiltonian [6] 

H=~ E \ji 1 ..i P + jh..i P ]sn- s i I > (!) 
l<ii..<ip<JV 
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Here jf l Ap are ferromagnetic couplings. 

Jh-ip = Vh-Vi p %r, Vi = ±1 (2) 
and for quenched noisy couplings ji lm .i we have distribution 



It is easy to show, that for large values of p (best case-P = N/2) there is a 
factorization for energy level distribution. For every a ^ (3 

P(E a ,Ep) = P(E a )P(E f3 ) (4) 

For the 1-st configuration with s, = 1 we have a distribution [9] 

P 1 (E 1 ) = -JL exp[-(P 1 + J N) 2 /N] (5) 

and for other 2^ — 1 levels 

P(E) = - / L=exp(-E 2 /N) (6) 

While calculating free energy we performing averaging via energy level dis- 
tribution (instead of random couplings in usual case of disordered systems) : 

< In Z >=< In ]T exp (-(3E a ) > E (7) 

a 

here (5 is inverse temperature. It is possible found [5], that at high enough 
values of J at low temperature system is in ferromagnetic phase with mag- 
netization 

mi = r]i (8) 

Later for convenient we take rji—1. 
Using the trick [6] 

InZ = !*(!) + r lnt deXP }~ tz] dt (9) 

J-oo at 



2 



one can factorize integration via different energy levels E a it is possible to 
derive 

< InZ >= r'(l) + r u^j^-du (10) 

J — oo (til 

y(u) = {f(u + u f )f(u) M } (11) 
where u = lnt,u f = J N(3, A = By^N, M = 2 N - 1 and 

f(u) = — / exp[-y 2 - e u exp(-Xy)]dy (12) 

\/7C J-oo 



| /-too 

— : / r(a;) exp[— -ux + \ 2 x 2 /A]dx 
2ni J-ioo 



In the last integral the loop overpasses point from right. Function f(u) is 
monotonic, like step. With exponential accuracy it equals 1 below 0, then 
become above it (with the same accuracy). We need in four asymptotic 
regimes 

f(u) w -L-r(2w/A 2 ) exp(-M 2 /A 2 ), A < u (13) 
V^tA 

1 r°° 

f(u) w / rfxexp(— x 2 ), A <C| u A 2 

/(u) ~ 1 - -L-r(-2w/A 2 ) exp(-M 2 /A 2 ), -A 2 /2 < u < -A 
V^A 

/(u) ^ 1 - exp( M + A 2 /4), —A 2 < u < -A 2 /2 

As the f(u + Uf)f(u) M is like to step function, its derivative is like to 5 
function with center coordinate at some — u . The vicinity of that point 
gives the main contribution to the integral in (11) (bulk value is equal to u ). 
Ferromagnetic phase appears, when the —Uf (the wall of function f(u + Uf) 
is left, than — V / iVln2A( the center of f{u) M ). For the boundary between 
FM and SG phases we have the line 



J = Vm2, oo > B > V\n2 (14) 
We using the property, that if there is only 1-st level, < In Z >= Uf = J NB 

/oo 
ud[f(u + u f )]=u f (15) 
-oo 
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Using this equality, after simple transformations we derive 

/oo 
u(M(u) (16) 
-oo 

/oo 
udm>i(u) 
-oo 

*!(«) = f(u + U f )[l-f( U ) M }du 

Let us first consider the exact border of 2 phases, 

J = y/W2 (17) 

We have for ^i(u) a product of 2 monotonic functions, decreasing (one-to 
the left, another- to the right) with the distance from the point u = —Uf. 
Let us introduce F(u) 

F'(u) = f(u + u f ) (18) 

At A <C| u |«C A 2 we derive 

ru/\ \ f-OO 

r [u — Ur) = / dx[-= / exp[-t 2 ]dt (19) 
Jo v 71 " J* 

C exp(-V/A 2 )] 



After transformations < In Z > goes to 

/CO /"CO 
udf(u + u f ) - / n#i(n) (20) 
-oo J —oo 

/oo 
-oo 

Let us perform integration by parts: 

roc , 

<\nZ>=u f + F (u)ty 2 (u)du (21) 

J — oo 

= u f + F(oo)# 2 (oo) - F(-oo)* 2 (-oo) - / F(u)m 2 {u)du 

J —oo 

= u f + [F(oo) - F(-u f )\ - F (-u f ) / (u + u f )V 2 (u)du 

J —CO 



Where ^(w) = (1 — f(u) M ) and we truncated expansion in degrees of u + Uf, 
because ^ 2 (u) * s similar to 5 function near the —Uf. The main correction 
comes from the second part: 



QyJ _/V f°° f°° 1 

<\nZ > -u f n dx exp[-t 2 ]dt ~ (22) 

y 7T JO Jx 

Let us consider now finite size correction for < (InZ — Uf) 2 > It is possible 
to derive 

<(lnZ) 2 >=r'(l) 2 + 2 [°° u^P-du (23) 

J-oo du 



where 
We have 



r°° arwut) , , 
+ / u ± u 2 - — ; — duidu 2 
J-oo du\du 2 

u = ln(e Ml + e" 2 ) (24) 



< (InZ - Uf) 2 > - < (InZ - u f ) > 2 (25) 

= / UiU 2 — — : — du\du 2 
J-oo du\du 2 

wx r°° (Nfi(u) , , f°° (NfAu) , N9 
-2(u f -T') u — -^-du-{ u — j^du) 2 
J-oo du J-oo du 

In this last expression the main part gives 

r°° (Nfiiu) , 
- 2u f / u — ^— — - du = 26 

J-oo du 



' " — / dx / exp[-t 2 }dt ~ A^2 

V 7T JO Jx 

Comparing (22) and (26) we see multiscaling property. This is the main result 
of our work. In [12] has been observed multicriticity at FM-PM transition 
point for the case of weak, ferromagnetic disorder. 
Let us now consider small deviation from (12) 

J = V^2 + ^ (27) 
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We can define the magnetization m using the formulas 
Using the identity -| = J °° dte~ tz It is easy to derive 

A poo A 



m 



In the main approximation we have 



m 

and for its differential 



! /*0O n"^ 

m = —= / <ixexp( ) (30) 

\J 7T J- ui 2 

Using the formula for magnetization we derive 

d < \nZ > 1 f°° r 9i , /^-x 
= m = r= = -= / exp \-t 2 ]dt 31 

^ = ^exp[-( Ml ) 2 ] (32) 
djo 

We see, that at u± — this quantity is maximal. So in our region (ex- 
act border SG-FM) our the dependence of magnetization from the external 
(ordered, manageable) parameter is maximal. Perhaps this (instability) prop- 
erty is the orign of edge of chaos's popularity in complex adaptive systems 
(CAS) [2]. Here one has some ordered external parameter to manage the sys- 
tem as well as some random parameters. There is some emergent (completely 
collective) property, like magnetization. The interaction measure with envi- 
ronment for our system is some fitness function from that emergent property. 
So it is highly reasonable, that CAS drifts to the maximal instability point, 
where the dependence of this emergent property from the ordered par ameter 
is maximal. 

So we are suggesting as complexity: 

A. There is an emergent property, which is maximally unstable under the 
change of ordered external parameters. 

One can apply this criteria of complexity to both disordered (like SG) or 
ordered (like ferromagnetic Ising) models. We see, that it distinguishes crit- 
ical regions. This criteria could be applied even for single and finite element 
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systems, we need only in mapping J — > m. If we want to distinguish SGF- 
FM transition point from PM-SG one, we need to increase our criteria by 
additional constraint. 

B. We should have free energy for our system at different scale N, and some 
ensemble of such systems (may be at different space or time scale). At com- 
plexity phase free energy's finite size corrections should have multiscaling. 
In multiscaling phenomena, as it is known [10], it is possible to define free 
energy like quantities , proportional to logarithm of scale. So we can give 
second (rather speculative) form of additional criteria instead of B: 

C. There should be in our system usual free energy and second fine form of 
free energy, highly suppressed in magnitude compared with the first one. 
This second formulation is more elegant (while speculative), perhaps it could 
work for a single system also. 

So in contrary to other approaches we are using free energy instead of en- 
tropy. Why? 

Free energy is manageable (via external parameter) part of energy. In the sit- 
uation, when there are both thermal noise and noise in external parameters, 
it is reasonable to consider just this (manageable via temperature) amount 
of energy. We see also in o ur toy model, that entropy has not multiscaling. 
Let us remember the multiscaling [10-ll]in details to clarify criteria C. One 
considers some geometrical objects in a box with macroscopic size L and 
microscopic cutoff a with corresponding probabilities p x . Then it is possible 
to introduce 2 sets of i ndices [10]: 

r (?) = lim R i 7I yln(E ;c ^) (33) 

If our probabilities p x scale as / da' p{a'){j)~^ a '\ then two sets of indices 
r(q) and f(a) are connected by a Legendre transformation [10] 

a- ^ 

a ~ dq (34) 

/(«) = aq-r(q) 

One can take as p x free energy's finite size correction, then r(q) is free energy 
density for the new system with — ln(a/L) volume and q is inverse temper- 
ature [10-11]. New free energy describes the change of critical indices under 
the change of his internal parameter q. What is important, it is tiny, pro- 
portional to InL instead of L for usual free energy F. This highly resembles 
schemata (compressed crucial information) in CAS according to M. Gelmann 
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[7], as well as free energy for strings and conformal models [5]. 
We give qualitative and descriptive definition of complexity on the ground 
of free energy. If the structure of theory is more or less known, one can use 
our criteria to establish a complexity. 

It will be very interesting to construct generalization of REM (GREM) with 
different scaling for free energy corrections, as well as try to find for any case 
of multiscaling corresponding REM (for finite size correction). In [11] there 
is an example of s uch connection. 

If such correspondence could be found, there is a chance for self-referentiality 
(finite size corrections of REM could be described by means of another REM). 
In [13] the author argued, that this property was crucial to make conscious- 
ness possible in mind -brain systems, and suggested, that it could be in other 
complex systems. 

So there is a good chance, that REM catchs the main features of complex 
adaptive systems. 
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